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THE MATERIALS DIVISION: A CASE STUDY 


Salvatore J. Grisaffe and Carl E. Lowell 
National Aeronautics and Space Administration 
Lewis Research Center 
Cleveland, Ohio 44135 


This presentation is a review of the efforts of the Materials Division at 
NASA's Lewis Research Center to evaluate the quality of the Division's output 
and use that evaluation to improve performance. A brief description of the 
Division will be presented which will be followed by a discussion of the steps 
taken to improve the quality of our output and evaluate the effectiveness of 
those steps. 

The Materials Division's Branches as well as the broad spectrum of techni- 
cal disciplines which the organization encompasses are shown in figure 1. 

With about 190 direct staff (approximately 105 C.S. plus SSC, on-site univer- 
sity, industrial guest investigators, NRC post-doctoral fellows, etc.) and 
only 16 managers, the span of control is rather broad. In addition, segments 
of Branches are located in different buildings expanding the problems of 
direct supervisor/staff interaction. 

The Division's job stretches from generic, rather basic research and 
modeling aimed at new understanding of barrier problems to the identification 
of new materials and processes (fig. 2). All of this creates new materials 
options for NASA and the aerospace industry to apply toward our very challeng- 
ing future missions and commercial /mi 1 i tary propulsion and power systems. 

Some of these results are focused on more mission-specific materials needs 
such as very high performance aircraft turbine engines or large space power 
generators. In selected cases, an ongoing flight project requires direct 
materials support when a problem arises in fabrication or hardware performance. 
In such instances, the full theoretical background and experience of the Divi- 
sion can be focused to get a rapid, feasible solution. 

The complex relationships our Center has with its customers and which we, 
as a microcosm of the Center, also have is displayed in figure 3. Basically, 
we have these three sets of customers: our Headquarters offices that provide 

the direct funding via interaction with the executive and legislative arms of 
government; our government customers - both within NASA and beyond - who use 
our technology to enable enhanced mission performance; and our industrial cus- 
tomers who take pieces of our work and adapt them to commercial systems. In 
addition, as a research laboratory, we have peers for whom we also provide 
scientific understanding, new ideas, and reports. 

It is important to continually interact with our customers. Based on 
their inputs and our own creativity, we couple key national needs and opportu- 
nities. Plans are formulated to pursue these needs but by the time specimens 
are fabricated, test capability set up and checked, etc., several years can go 
by. Thus, the needs themselves or the people who articulated them may have 
moved to other organizations. For this reason, continuing feedback and discus- 
sion is necessary to close the loop (shown in fig. 4). 



Figure 5 compares the different measures of success faced by our research- 
ers versus our technologists. Different customers have different needs. The 
research customers base success on new ideas and publications. A continuing 
flow of these useful contributions is important. For our technology custom- 
ers, success is the timely delivery of concepts that can be used, i.e., 
converted into tools or hardware for a reasonable additional investment. 

We identify some of the efforts we have made to better meet all of our 
customers needs in figure 6. In the subsequent figures, we will try to provide 
examples of the approach and results. 

An approach taken to see what our industrial customers really valued and 
what they felt we needed to work on to satisfy their future needs is shown in 
figure 7. The results, of course, are proprietary to each company. However, 
some things we gave low priority were viewed very highly by industry. This 
feedback caused us to rebalance part of our work and our resources. 

Figure 8 shows the results of a nonparticipative edict in 1983 when this 
present management took charge of the Division - "Shift reporting to peer- 
reviewed journals" rather than publishing in NASA internally reviewed reports 
which have a more limited distribution. Journal articles doubled and have 
remained a substantial fraction of our output of reports, conference proceed- 
ings, book chapters, etc. 

To go beyond just report quantity, we instituted our pilot effort to 
assess report quality and developed the framework shown in figure 9. Note the 
quality of the research and the potential Impact on NASA needs combine to be 
predominant factors rather than being concerned only with the writing clarity, 
etc . 


The evaluation of these reports by both the first line supervisor (Branch 
Chief) and by Division management (Deputy Division Chief) are reasonably 
close. A plot of the scores is shown In figure 10. If a major disagreement 
arises, a third party (the Division Chief Scientist) also evaluates the report. 
Figure’ll shows the distribution of scores since we started this process in 
9/87. The preponderance of reports rate very good to excellent. Figure 12 
shows a very slight trend upward in scores. We will continue to foster 
Improvements and yet need to be alert to "grade creep." 

We are also working to upgrade the technical skills of our staff. One 
aspect has focused on hiring with graduate training. Figure 13 shows the heavy 
concentration of MS and PhDs hired since 1983. These figures, of course, 
reflect both C.S., and SSC hiring. 

Once hired, we are working to better mentor our.new people. Our recently 
developed formal approach to mentoring is shown in figures 14 to 16. To date, 
it is too early to judge the results but we feel we're moving in the right 
direction . 

Discussion topics related to career review were formalized on a division- 
wide formal basis in 1989 (although many of these topics always have been 
covered informally). Here we are trying to get the issues discussed that 
relate to actions that the individual and management must take to help each 
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person move their career in the direction that they want it to go. The form 
used as a guideline for these discussions is presented in figure 17. 

To move toward better management, we've been surveying our staff for over 
5 years as to how they felt about Division management. The form used is shown 
on figures 18 and 19. Basically, we ask them to anonymously rate the two of 
us overall, and on the three major strategic growth directions the Center is 
pursuing. The only identifier is the Branch Code so we can spot any local 
trouble or organizational-specific issues. We also ask for additional input 
as to how things are going from their view. We then tabulate all the data, 
summarize it by Branch, and have a feedback session where we discuss the prob- 
lem areas and what we will try to do to improve. 

A similar questionnaire that was developed in 1988 for the staff to rate 
their Immediate supervisor is reproduced as figures 20 and 21. Again, the 
Inputs are anonymous. One, noninvolved secretary collects all the responses, 
tabulates the data, lists all the comments separately (so scores and comments 
are not tied together) and gives me the floppy disks. Then she destroys the 
original forms. While we lose somewhat in not being able to correlate score 
and comment, the preservation of anonymity is essential. The results were 
very positive. A few managers got some specific areas to work on and in 
general we were told we need more focus on better soliciting staff input. 

Figure 22 reflects that Lewis Materials Division is among the top organi- 
zations in the U.S. We will not be satisfied with that, however - we will con- 
tinue efforts to be the top. 


THE DIVISION 


PROCESSING SCIENCE & TECHNOLOGY 
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ENGINE MATERIALS PROJECT OFFICE 


RESOURCES 

• 190 PEOPLE 

140 SCIENTISTS & ENGINEERS 
16 MANAGERS 
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• 7 BUILDINGS — MULTIPLE 
LABORATORIES 


FIGURE 1. 
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NEW ORGANIZATION | 

NEW PEOPLE J 

NEW MISSIONS 
NEW NEEDS 


MATERIALS 


• NASA/DOD/INDUSTRY CUSTOMERS 

• PREDICTIVE MODELS OR NEW 
MATERIALS/PROCESSES ARE OUTPUT 


• SCHEDULE CUSTOMER -DRIVEN AND 
NEEDED RESULTS MORE CLEARLY 
DEFINED 


MATERIALS DIVISION 
CUSTOMER FEEDBACK SOLICITATION 

WHAT TWO THINGS HAVE WE DONE IN 1988 THAT HAVE BEEN OF MOST USE TO YOU? 
WHY? 

WHAT TWO THINGS COULD WE FOCUS ON IN 1989 THAT WOULD BE OF MOST USE TO 
YOU? 

WHY? 

WHAT LONGER RANGE RESEARCH ISSUES WOULD YOU LIKE US TO EXPLORE 
INTERNALLY TO MOST HELP YOUR ORGANIZATION? 

WHY? 


FIGURE 7. 




First Line Supervisor Scores 
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Historical Perspective on Report Quantity 



Title: 

Author ( 5 ) : 

Date In: Date Out: Evaluator: 

Score range in each single box is 1 to 5, 
5=0utstanding 4~Very Good 3=Good 2 =Marginal l=Inadequate 
Each double box is total of the three single boxes below it. 


OVERALL SCORE 

(total of the three double boxes) 



QUALITY OF RESEARCH QUALITY 07 WRITING 


POTENTIAL IMPACT 


a 


PREPARATION 1 1 

Purpose of the work: 
worthwhile? relevant 
to NASA? well defined 
at the start of the 
of work? 

Literature survey: is 
it relevant? is it 
adequate? 


APPROACH 1 1 

Materials: proper for 
work? adequately 
characterized? 
Equipment: 
proper for the job? 
properly calibrated? 
properly operated? 


RESULTS 1 ' 

Data: relevant to 
objective? enough? 
valid? reproducible? 
Interpretation: 
correlations sought 
and identified? 
cause and effect 
relations proposed? 
distinction between 
correlation and 
cause/effect 
realized? 

mechanisms proposed? 
was objective met? 



OPENING 1 1 

Title descriptive? 
Abstract descriptive? 
Introduction: 
relevant, adequate, 
clear? 

Objective explicitly 
stated? 


BODY 1 1 

Methods clear? 

Quality figures and 
tables? 

Logical development 
of result and 
discussion? 

Results compared to 
literature? 

Results interpreted 
objectively? 


ENpiNG 1 — 1 

Conclusions : 
significant? 
supported by data? 
relevant to 
objective? 

significance of work 
explicitly clear? 

Future directions 
suggested? 

Entire paper well 
organized, easy to 
read, good 
transitions, 
concise? 


CZI 


Strong interest at 
LeRC, Hdqr, other 
centers, other 
agencies? 

Does it address a 
specific NASA 
problem? 


AEROSPACE PROPULSION/ 
POWER INDUSTRY ; 1 


New material/process? 
Lower cost, longer 
life? 

Patentable? 

Likely to be used? 


COM MUNIIX 


New insight, concept, 
interpretation, 
model? 

Attract attention 
outside of 
power/propulsion 
community? 

Likely to become 
long term standard 
reference? 


FIGURE 8. 
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TWARD A STRONGER MATERIALS DIVISION ffi TIglJfPSMM 

CONDITIONS 

• TOP RESEARCHER (OR PROJ. MGR. /SUPPORT PERSON/ETC.) SELECTED FOR 
MENTOR POOL — MENTORS ARE A SPECIAL CLASS — BOTH TASK AND PEOPLE 
ORIENTED - 


• FORMAL ASSIGNMENT FOR 1-3 YEARS - 1 OR 2 MAX. INDIVIDUALS PER MENTOR 


• CMR ON PERFORMANCE PLAN 

• REDUCE LOAD OF UNPALATABLE WORK 

• QI/SSP/SAA POTENTIAL ON COMPLETION 

• CO-AUTHORSHIP ON FIRST PAPER 


• MENTOR RESPONSIBILITIES: TO UNCOVER AND/OR DEVELOP STARS - MAXIMIZE ALL 
NEW STAFFER CAREERS 


- 70* GROWTH VIA OJT ; 
-LEARN BY DOING - 
-ASSIGN JOBS TO 
FILL GAPS & 

STRENGTHEN WEAK 
AREAS 

• B.C.+ MENTOR INVOLVED 


20* GROWTH VIA ; 
FORMAL TRAINING 
-GRAD SCHOOL. 

SHORT COURSES, ETC. 

• B.C.+ MENTOR INVOLVED 


10* VIA MENTORING 
-LEARN FROM OTHERS 
EXPERIENCE 
• MENTOR 

-HOW TO GET THINGS DONE 
-REPORTING PRESENTING 
-HOW TO PLAN YOUR WORK 
-HOW TO DO LIT. SEARCH 
-HOW TO DESIGN 
EXPERIMENTS 


FIGURE IN. 


FIGURE 15. 
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• BRANCH CHIEF IDENTIFY POTENTIAL MENTORS 


t NEW PERSON DISCUSS POTENTIAL RESEARCH WITH ALL OF BRANCH 

• DEVELOP A SHORT LIST OF POTENTIAL fffNTORS IN FIRST MONTH 

t discuss wrm b.c. 

# REQUEST MENTOR - BUT CHANGE IF IT DOESN'T WORK 

FI6URE 16. 


CAREER REVIEW 

NAME: 

YEAR:. 
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1988 
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• general aspects of the way the division runs 
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0 5 io 
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0 5 jo 
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PROGRESS YOU SEE: 


MAJOR PROBLEMS YOU SEE: 


PROGRESS YOU SEE: 
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• EXTERNAL IMAGE 

MAJOR PROBLEMS YOU SEE: 


[ ' I ‘ PROGRESS YOU SEE: 

0 5 TO 

SUCCESSFUL 

COULD IMPROVE BY: 


YOUR JOB 

THINGS THAT HAVE HAPPENED THIS YEAR WHICH IMPROVED YOUR ABILITY TO DO A SOLID JOB ARE: 


THINGS THAT STILL GET IN YOUR WAY TO ACCOMPLISH YOUR JOB: 


YOU 

• THINGS YOU DID THIS YEAR TO BUILD YOUR SKILLS/DEVELOP YOUR CAREER ARE: 

• THINGS YOU'D LIKE THE DIVISION TO DO IN ’89 TO BUTLD YOUR SKILLS/DEVELOP YOUR CAREER: 

OTHER SUGGESTIONS/COMMENTS : (USE BACK OF THIS PAGE) 

FIGURE 19. 
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RATE YOUR SUPERVISOR I 


SUPERVISOR OFG. CODE_ 


Branch chiefs and their deputies in the Materials Division 
are seriously interested in obtaining your perception of 
their effectiveness as a manager. This questionnaire is a 
means of obtaining Information that will assist them in 
improving their performance, both actual and perceived. You 
are requested to assess your supervisor's effectiveness in 
three general areas: Technical Direction, Organizational and 
Personal. Each area has subcategcries which encompass 
responsibilities of supervisors. Please rate your 
supervisor { s ) for each question and assign a ranking to each 
in terms of how important the implicit aspects included in 
each question are to you. You are also encouraged to include 
specific Individual comments . Anonymity is requested. 

Results will be shared by the division chief and respective 
supervisors. 


Rating: l=Good 2=Average 3=Poor 

Importance: l=High 2=Medium 3=Low 


Rating 

TECHNICAL DIRECTION 

1. Possesses adequate understanding of 
technology in area he/she manages. 

Importance 

2. Formulates overall technical program 
and qoals for the Branch. 


3 . Provides adequate technical input 
to the Branch effort. 


4. Solicits your input. 


ORGXHT ZATIONAL 

5. Obtains funding, equipment, space 
and personnel to carry out technical 
programs of the Branch. 


6. Interacts effectively with upper 
management. 


7. Acts as effective buffer between you 
and upper management. 


8. Sets up teams to accomplish technical 
goals . 


9. Fosters communications within Branch. 

10. Provides timely support to address 

organizational, personal, etc, problems. 

11. Solicits your input. 



FI6URE 20. 


PERSONAL 


12. Aids in achieving vour career goals. 

13. Advocates promotions and awards when 
warranted. 


14. Aids in formulating performance plans 
and provides helpful feedback. 


15. Is approachable and willing to 

communicate on individual basis. _ ... 

16. Is fair and evenhanded in dealing 
with Branch members. 


17. Solicits vour input. 



Please indicate your perception of the amount of time your 
supervisor devotes to each major category together with what 
you think would be an ideal allocation of their time. 


Perceived % Time 

18. TECHNICAL DIRECTION 

Ideal % Time 

19. ORGANIZATIONAL 


20. PERSONAL 



SPECIFIC COMMENTS (continue on separate sheet if desired } 


SUGGESTIONS TO IMPROVE THIS QUESTIONNAIRE OR THIS EXERCISE 


FIGURE 21. 
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Ultra-high-temperature metals research 


Lewis Research Center is the hub of the NASA Advanced High Temperature 
Engine Materials Program. Other significant efforts are being conducted at the 
AFWAL Aero Propulsion and Materials Laboratories. DOE's Oak Ridge Na- 
tional Laboratory and Los Alamos National Laboratory are involved in develop- 
ing intermetallics and beryilides and modeling their physicochemical 
characteristics, respectively. DARPA is sponsoring advanced programs on inter- 
metallics with emphasis on a titanium aluminide program and a copper niobium 
microcomposite program. Numerous contractors and universities are pursuing 


high-temperature materials programs. 
NASA-Lesvis MMC Programs 

Metal matrix composites research and 
development at NASA-Lewis Research 
Center focuses on advanced high- 
temperarure materials for future aerospace 
propulsion and power systems. Many of 
the continuous fiber-reinforced metal ma- 
trix composites fabricated at NASA-Lewis 
utilize its arc-spray monotape fabrication 
process (described in the March 1987 is- 
sue of Current Highlights ) . A major em- 
phasis has been on the development of 
tungsten-fiber- reinforced superalloys to 
improve creep properties and increase al- 
lowable operating temperatures for turbine 
blade and vane applications in aircraft en- 
gines A significant factor with fiber- 
rein farced superalloys is the prevention of 


fiber/matrix interaction, which could de- 
grade the properties of the reinforcing fi- 
ber. In the worst case, the fiber and matrix 
react during high-tempera ture fabrication 
or service, forming brittle intenmctallic 
compounds or degrading the fiber. It has 
also been found that conventional nickel- 
base superalloys can cause a diffusion- 
triggered recrystallization within the 
tungsten wire, causing the fiber to lose its 
strength and ductility with time. To reduce 
these degradation reactions, modified Fe- 
CrAlY superalloys are being used as a 
matrix material because iron-base alloys 
have much better compatibility with tire 
tungsten fiber and provide an oxidation- 
resistant, high thermal conductivity, duc- 
tile matrix to complement the properties 


FIGURE 22. 
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